Multi-scale tensor network architecture for machine learning

نویسندگان

چکیده

Abstract We present an algorithm for supervised learning using tensor networks, employing a step of data pre-processing by coarse-graining through sequence wavelet transformations. These transformations are represented as set network layers identical to those in multi-scale entanglement renormalization ansatz network. perform and regression tasks model based on matrix product states (MPSs) acting the coarse-grained data. Because entire consists contractions (apart from initial non-linear feature map), we can adaptively fine-grain optimized MPS ‘backwards’ with essentially no loss performance. The itself is trained adaptive density group algorithm. test our methods performing classification task audio temperature time-series data, studying dependence training accuracy number showing how fine-graining may be used initialize models which access finer-scale features.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multi-resolution Tensor Learning for Large-Scale Spatial Data

High-dimensional tensor models are notoriously computationally expensive to train. We present a meta-learning algorithm, MRTL, that can significantly speed up the process for spatial tensor models. MRTL leverages the property that spatial data can be viewed at multiple resolutions, which are related by coarsening and finegraining from one resolution to another. Using this property, MRTL learns ...

متن کامل

An Adaptive Sensor Network Architecture for Multi-scale Communication

Sensor networking has emerged as a promising tool for monitoring and actuating the devices of the physical world, employing self-organizing networks of battery-powered wireless sensors that can sense, process, and communicate. Such networks can be rapidly deployed at low cost, enabling large-scale, on-demand monitoring and tracking over a wide area. Energy is the most crucial and scarce resourc...

متن کامل

An Adaptive Scheduling Protocol for Multi-scale Sensor Network Architecture

In self-organizing networks of battery-powered wireless sensors that can sense, process, and communicate, energy is the most crucial and scarce resource. However, since sensor network applications generally exhibit specific limited behaviors, there is both a need and an opportunity for adapting the network architecture to match the application in order to optimize resource utilization. Many app...

متن کامل

Learning Relevant Features of Data with Multi-scale Tensor Networks

Inspired by coarse-graining approaches used in physics, we show how similar algorithms can be adapted for data. The resulting algorithms are based on layered tree tensor networks and scale linearly with both the dimension of the input and the training set size. Computing most of the layers with an unsupervised algorithm, then optimizing just the top layer for supervised classification of the MN...

متن کامل

Unifying Multi-domain Multitask Learning: Tensor and Neural Network Perspectives

Multi-domain learning aims to benefit from simultaneously learning across several different but related domains. In this chapter, we propose a single framework that unifies multi-domain learning (MDL) and the related but better studied area of multi-task learning (MTL). By exploiting the concept of a semantic descriptor we show how our framework encompasses various classic and recent MDL/MTL al...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Machine learning: science and technology

سال: 2021

ISSN: ['2632-2153']

DOI: https://doi.org/10.1088/2632-2153/abffe8